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ABSTRACT 


A vigilance experiment was performed to evaluate the ef- 
fect of monetary incentives on visual monitoring performance. 
The vigilance task was the detection of a slightly larger ex- 
cursion of a voltmeter needle making 50 uniform excursions 
per minute. The length of the vigil was 48 minutes, during 
which 32 signals were presented. Ten subjects (Ss) in ageeqs 
trol group performed the task without possibility of reward. 
A second group of 10 Ss performed the identieal task receie 
ing monetary rewards based on performance. Subjects receiv- 
ing monetary rewards (M) detected significantly more Signals 
(p> < .001) than did the control group (NM). A significeme 
time decrement (p < .002) and a Significant interactions 
tween group and time existed (p < .001). The detectability 
(d') or sensitivity for the signals remained essentially in- 
variant for both groups, although slightly greater for group 
M, and the criterion level (beta) was comparatively lower for 
group M. The cost factors were effective in manipulating 


monitoring performance. 


TABLE OF CONTENTS 


i INTRODUCTION AND BACKGROUN D---------3- 3-7-3 ----- 9 
II. METHOD--------------------------------------------- 7 

A. APPARATUS-------------------------------------- 17 

B. SUBJECTS ----------------------- -- -- -- -- -- ---- 18 

C. PROCEDURE-------------------------------------- 18 
TET & SES 0 Se ee 19 
OE CCUC STON === === == = eo a ae 23 
BIBLIOGRAPHY -------------------------------------------- 29 
fiiiettas OPS TRLBULTEON Lilo! -——=——=<—-—————<-—-----—_- ot 
POR DD ld73—=——— = — — a 33 





ie, 


bio tSOr TABLES 


Analysis of variance of arcsine transformation 


of signals detected------------------------~-------- 





LIST OF FIGURES 
Mean percentage of signals detected as a 
function of time---------------------------------- 25 


Mean percentage of false alarms as a 
function of time---------------------------------- 26 


The quantities d' and 8 as a function 
Fa oS SN eg ng ee ee eee ee ee 27 


The quantity (log 8)/d' as a function 
of time---------------------------------+------—---- De 





a 


I. - INTRODUCTION AND BACKGROUND 


Extensive research has been conducted concerning vigi- 
lance tasks in which man 1s required to detect randomly and 
infrequently occurring events. The vast majority of this 
effort has been concerned with discovering what physical-task 
parameters may be responsible for vigilance decrement, i.e. 
the decrease in vigilance performance. Recently, however, 
some attention has been devoted to motivation as the key to 
understanding vigilance behavior. A catalyst precipitating 
this line of reasoning was the fact that performance improved 
Tee. Know ledgesor results ~yiee. celling subjects (55) Swen 
correct detections and false alarms were made. (Wiener 1963, 
and others). In actual monitored systems, however, knowledge 
of results would be unavailable, or at best extremely delayed. 
If the feedback circuitry, human or electronic, were capable 
of providing immediate knowledge of results, the occurrence 
of a Signal would have to be known, and the need for a human 
monitor would be eliminated. 

Several other methods of motivation have been attempted 
with varying degrees of success. Baker, Kowal and Ware (1964) 
pormted Out that experimenter (5) attitude “coward. Che os 7srg— 
nificantly affected their performance on a vigilance task. 
Several studies (Pollack and Knaff, 1958; Sipowica, Ware and 
Baker, 1962; Bergum and Lehr, 1964; Levine, 1966; and Smith, 
Lucaccini and Epstein, 1967) have employed monetary incentives 


rOLuInerease MOtLVvatlon, 


Pollack and Knaff (1958) reported a slight improvement 
in detection performance when Ss were given the incentive of 
"an extra hour of pay" for either 100 percent detection in 
seven of eight 10-minute periods or the greatest improvement 
in scores Over previous tests. Subjects were guaranteed pay 
for 50 hours of service and the incentive of "an extra hour 
of pay" was not quantified. 

Sipowicz et al. (1962); Bergum and Lehr (1964); Levine 
(1966); and Smith et al. (1967) all provided rewards in pro- 
portion to the number of targets detected, minus varying 
punishments for missed signals and false alarms. All experi- 
ments yielded some degree of improvement in results as com- 
pared to a non-motivated group. 

These monetary incentives were, however, subjectively 
arrived at. Classifications such as "low incentive", "medium 
incentive", and "high incentive" were used in a subjective 
manner. Utility and/or decision theory may be used to help 
quantify the experimental incentives used. 

Utility theory suggests that the costs and values of de- 
ciding whether or not a Signal is present can be illustrated 
bya Utility decision macri«.; 


UTELIZY DECESION MATRIX 


S S EY 
5 No 
R a - A 
R = + B 
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S = signal present S = no signal present 
Re= response Ee no response 

T) = a priori probability of no signal being present 
i priori probability of a signal being present 


EV = expected value (average utility) of decision 
The +'s and -'s represent the utility points associated with 
eeeeeicular action. ~The S theoretically would seek toe maxi- 
mize his EV and therefore one should assign incentives such 
that A is poSitive and A > B. If, for example, A = -2 and 
B = 3, S would decide to "not respond". However, Galanter 
(1962) found that at best a logrithmic relationship existed 
between money and utility, making the assignment of utility 
peaints very diisficult. 

A second approach is to use the statistical tool of deci- 
sion theory, and by applying one of the developed criteria 
for an optimum decision rule, arrive at the proper costs to 
apply in order to minimize the risk of making a decision. 

Direct application of the above two approaches would be 
very difficult however, since, as shown by Egan, Greenberg 
and Scnulman (1961); Weiner, Poock and Steel (1964) as re- 
analyzed by Taylor (1965); Levine (1966); and others, the 
vigilance decrement is not due to a change in the efficiency 
Ta eto es Selceo UL naA Ele hea c) treet ime nte Ss Seer intemlOn » fOr 
response in the direction of greater conservatism. In other 
words, the detectability of the signal remains constant, but 
it is the S's criterion that changes. This means that the S's 
utility decision matrix or the costs and/or the probabilities 


of a signal being present, change with time. Thus the S's 


dell 


decision rule changes as a function of time. Deese's expect- 
ancy theory (Deese 1955) states, in brief, that @aheplikelinoed 
that the subject will respond to a randomly occurring signal 
depends upon his expectancy about the appearance of a signal. 
This expectancy is built up as a kind of "averaging process" 
based on past signals, implying that to the observer, the 
probabilities of signal presence change with time. Several 
studies (Jerison, Pickett and Stenson, 1965; and Mackworth, 
1968) found that an increased signal rate did actually de- 
crease the probability of detection. 

This study will assume fixed a priori probabilities in 
order to isolate the effect of monetary costs on motivation, 
and ultimately vigilance performance. However, additional 
research in support of Deese's theory certainly seems 
warranted. 

The current study will attempt to decrease the vigilance 
decrement by inducing motivation through statistical assign- 
ment of the costs of the decision parameters in order to 
optimize the observer's decision criterion. These costs of 
the decision parameters will be constant, although further 
study should be made to determine the significance of this 
type of value assignment. 

In order to manipulate the costs of making a decision as 
a function of time in a laboratory environment, a procedure 
Similar to knowledge of results would have to be employed. 
Therefore this study will assign fixed costs to the decision 
parameters. Although internal inhibition or caution apparently 


increases with time, when a S does become more reluctant to 


dZ 


respond to the presence of a signal his non-optimal payoff 
should dictate that he is no longer maximizing the expected 
value of his decision rule and the inhibition should dissipate. 
thus, che S sheuld return to the original decision costs. 

Signal detection theory (Green and Swets, 1966) was ap- 
pied Ia ene (current experiment. ~ This theery is based™on the 
concept that signals are detected against a background of 
"noise". This noise represents random variations in the chan- 
nel through which the signal reaches the decision function. 
Any specific observation may come from one of two populations, 
either noise alone or noise plus a signal, and the observer 
must decide whether or not he will accept that observation as 
a Signal. The difference between the means of the distribu- 
tions of the two populations, noise and signal volus noise, is 
the detectability of the signal. When the two distributions 
are Gaussian and of equal variance, the difference between 
the means divided by the standard deviation is designated d'. 
The meaSure of the sensitivity of the observer for the sig- 
nal is independent of his decision criterion. The decision 
Criterion is measured by the parameter 8, where the accept- 
ance region for a positive response consists of all events 
whose likelihood ratios are equal to or greater than 8. An 
increase in 8 indicates an increase in caution by the 
observer. 

It will be assumed that the detectability of the signals, 
d', 1s essentially constant as verified for the Jump Clock 
Test by Mackworth (1968) and in general by Loeb and Benfold 


(1964) and Levine (1966). 


ds. 


The costs for the decision parameters were calculated 
using the Neyman-Pearson decision rule which yields a specific 
likelihood ratio value, 8, for a specified a priomi probabal— 
ity of false alarms (see Selin, 1965, Chapter 2). This spe- 
cific value of 8 was then used in the Bayesian decision 
criterion in order to obtain a ratio of the costs for “me 
decision parameters. The Bayes criterion consists of minimiz- 
ing average cost when the a priori probabilities are known 
and the average cost is a linear function of the absolute 
error probabilities (see Selin, 1965, Chapter 2). By assign- 
ing a specific value to the probability of false alarms 
(a2 = .05) ultimately a ratio of costs can be determined. In 
other words the decision maker is maximiZing the acceptance 
of a Signal when there is a signal present, while holding a 
constant probability of false alarms. 


The actual calculations are as follows: 


f(x|s) = p.d.f. of signal plus noise 
f(x|n) = p.d.f. of noise alone 
Coo = cost of correct rejection 
Col = cost of miss 
Cid = cost of correct detection 


Cio = cost of false alarm 


ioe priori probability seg sno 
Signal being present 


Tm = a PLIOMl- probability of a 
Signal being present 


O = probability of false alarm 


B = critical value of likeliheedeaarie 
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Assume f(x|/n) is N(0,1) and f(x|s) is N(ys,1); then for 


this case, by signal detection theory: 


i. = Hi f (c(i) lx 


This experiment will assume a = .05 8 = 1.645 (from table of 
normal distributions). 
Using the Bayes decision criterion likelihood ratio 


aes) 
me gl iat 8 


_ T (Cy 9-CoQ) 
eee ee 
T4 (Co y-Cyy) 


To and T™, were determined from the experimental target pre- 


sentation, thus the known values were: 


Ty = 9867 
T) = Oss 
6B = 1.645 


rearranging the above known values yields 


(C1 9~C Qo)? 


022 = 
* (Cc. =C-.). 
(C55 O79) 


The theory thus yields an infinite number of possible combina- 
tions that satisfy the above ratio. For this experiment, the 


following combination of values was chosen: 


Cio = 2 
Cog = 3 
Col = 4.55 
C14 = 50 


aes 


Cel aio “11 


implicitly indicates some form Of aELlity eassessmente Hieeeiic 


Any assignment of specific costs to Cog: 


recommended that a further study be conducted uSing various 
ranges of costs with a fixed ratio, 8, to determine if there 
is any significant difference in performance as a result of 
the variation of the assigned costs of the decision parameters. 
As stated, human behavioral theory sometimes suggests that 
subjective probability, not a priori probability, and Wel 
not monetary value, determine the S"s decision. If wewaleua— 
nonlinear transformations of the values of the decision pa- 
rameters and of the a priori probabilities, the maximization 
of the subjective value would still have the form illustrated 
above. The only thing that would change would be the value 
of 8. The likelihood ratio criterion would still be the op- 


timal decision rule (Green and Swets, 1966). 
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iia METHOD 


A. APPARATUS 

The monitoring task consisted of the detection of an ab- 
normally large deflection of a voltmeter needle which made 
50 deflections per minute. The normal deflection and the 
Signal were produced by electrically energizing the meter. 
The signals were programmed on a paper tape and stepped 
through an Ohr-tronics 8-channel tape reader at a rate of 50 
characters per minute. Each character produced either the 
short background deflection of 25-degrees, Or a Signal, a 
32-degree deflection. The impulses appeared on a meter con- 
sisting Of a uniform white background and a black needle. 

The impulse circuit and damping characteristic of the meters 
were such that the impulse appeared as a rapid rise and fall 
Seeeee necdia with no pause or “bounce” at the peak, or bot-— 
COM rme needle returned*to its resting position before the 
next deflection. The S responded by pressing a silent hand 
Switch which activated a pen on a Lafayette Model 5040 multi- 
pen recorder. Signals were also automatically recorded in 
the same manner. Subjects wore earphones which played white 
noise at about 60 db to further assure auditory isolation. 

A schedule of 32 signals for the 48-minute run was deter- 
mined from a table of uniformly distributed random numbers. 
The only restrictions on randomness were that the minimum 
inter-signal interval was 0.3 minutes and that 8 signals would 


appear On Gach 12 mimute block. 


Ly 


Bs PovuBsECLs 
The Ss were 20 milit@amyeorticemigraduate seudemes armen 
Naval Postgraduate School. None had served previously in 


monitoring studies. 


CC; PROCEDURE 

The Ss were randomly divided into Group NM (non-motivated) 
and Group M (motivated), consisting of 10! Ss each.” Wdememeam 
instructions were read to each S at the beginning of the ex- 
periment explaining the nature of the task and the response 
procedure. In addition, Group M was given an explanation of 
the cost incentive matrix. This explanation included the 
fact that it was possible to earn between 10 and 15 dollars 
for a perfect performance. A maximum effort actually yielded 
$12.72, a conversion of .75 cents per cost matrix point. How- 
ever, to insure against any knowledge of signal presentation, 
the previously mentioned dollar range was given. A practice 
session consisting of 9 signals in rapid order followed in 
which knowledge of results was given. The E wamed thew@gs 
that the signals would not appear so rapidly in the actual 
experiment. The S was asked to remove his watch and the task 


was then begun with no interruptions permitted. 
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LTT. @BbSUlms 


A response within 2.0 seconds after presentation of a 
Signal was scored as a detection; all other responses were 
scored as false alarms. Figure 1 shows the mean percentage 
of signals detected as a function of time periods for both 
groups. These raw detection percentages were transformed to 
radians by the arcsine transformation in order to satisfy 
the normal distribution requirement for analysis of variance. 
A nested-factorial analysis of variance was performed on the 
tadians, with Ss nested into groups but common to the four 
time periods, see Table I. The difference between groups was 
Slgmrricant, F(l,18) = 16.43, p < .001, with the motivated 
group detecting a higher mean percentage of signals, Group M 


86.9%3, Group NM 68.5%. The analysis showed a significant 


ferent Over time perilods, F(3,24) = 7.80, p< -.001, as 
shown in Figure l. A significant interaction existed between 
qouos and time periods, f(3,54))= 8.50, p <~.001, due to a 


Significantly higher percentage of detections by the motivated 
group than the non-motivated group. 

Figure 2 displays the mean percentage of false alarms as 
a function of time periods for both groups. The percentage 
of false alarms was calculated utilizing the fact that it was 
possible to have 592 false alarms per 12-minute block, i.e. 
600 deflections minus 8 signals. A non-parametric median 
test, designed to measure whether the two independent groups 


differ in central tendency, indicated there was no significant 


ils, 


TABLE I 


ANALYSIS OF VARIANCE OF ARCSINE TRANSFORMATION 


OF SIGNALS DETECTED 


SOuUrce Glsts ms | F p 
Between Ss aS 
Groups (g) 1 D ones 16.434 <r 


Error (between) 18 0.3420 


Within Ss 60 
Time Periods (T) 3 Labo Leto < 20.000 
Gx fT 3 Evo. L 8.500 <. OU 
EGrors (wate 54 0.1971 

Total 719 
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difference between the means of the two groups at the 0.001 
level, vee =o. 05) peel the experimental xuange of 
percentage of false alarms, 3.6 to 1.0, approximated the a 
priori percentage of false alarms, .05. 

The calculation of d', the statistical difference or dis- 
tance between the means of the signal and signal plus noise 
distributions of equal variance, was obtained from a table 
compiled by Elliot (Swets, 1964), using mean percentages of 
Signals detected and of false alarms per group per time per- 
iod as suggested by Mackworth (1968). 

The parameter 8 was calculated by evaluating the likeli- 
hood ratio at the points indicated by the mean percentages of 
Signals detected and of false alarms, i.e. evaluate the ratio 
Gf the normal probability density functions f(x|s)/f(x\|n). 

The experimental values of the d' and 8 parameters for 
both groups are shown in Figure 3. These results indicate 
that d' remained essentially invariant for both groups, being 
slightly greater for group M; while except for time period l 
where 8 was approximately equal for both groups, 8 increased 
more rapidly with the NM group. This indicates that the 
detectability of the signals was approximately equal for both 
groups but, after the first time period the NM group was 
comparatively more reluctant to respond to a signal. 

Taylor (1965) indicated that 8 itself does not measure 
the placement of the criterion on the scaled log-likelihood- 
ratio axis, but rather the parameter (log 8)/d' should be 


evaluated. The decision need not be based on likelihood 


ex 


ratio per se, but the decision rule must be equivalent to a 
likelihood-ratio criterion in order for the relationship, 

d P(x|s)/d P(x|n) = -£(x|s)/-f£(x|n) = likelihood ratio, to 
exist (Green and Swets, 1966). A plot of (log 8)/d', Figure 


4, indicates the same trend as £8 in Figure 3. 
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iV. “DESCUSSTON 


The results of this study provide support for the hypoth- 
esis that when motivation is increased by monetary incentives, 
performance in a simple vigilance task can be significantly 
enhanced. This iS pointed out by the fact that the mean per- 
centage of signals detected, 86.9%, by the motivated group 
(M) was Significantly higher than the mean percentage of sig- 
nals detected, 68.5%, by the non-motivated group (NM). Sim- 
ilar results were reported by Pollack and Knaff (1958); 
Sipowicz et al. (1962); Bergum and Lehr (1964); Levine (1966); 
and Smith et al. (1967). 

The hypothesis that the detectability of the signal, d', 
is essentially constant was supported. For the first time 
period, d' was equal for both groups. During the remaining 
three time periods a slight overall rise in d' was found for 
the motivated group and a slight decrement for the non- 
motivated group. 

The decision criterion, as measured by beta, showed an 
imerease in Caution for both groups during each time Slock. 
During the first time block, beta was essentially the same 
for both groups. However, for the three remaining time blocks, 
beta increased more rapidly for the non-motivated group. 

This is consistent with the fact that the motivated group 
performed significantly better than the non-motivated group. 

The signal detection theory analysis of the results is 


consistent with those resulting from the analysis of variance. 


Zs 


Signal detection theory states that the significant difference 
in performance between the two groups resulted from the fact 
that the non-motivated group was more reluctant to respond to 
a Signal when one occurred, while the detectability of the 
Signals was essentially the same for both groups. 

It is recommended that in future studies utilizing mon- 
etary incentives a statistical evaluation of decision costs 
be conducted using decision theory and a Bayesian type deci- 
Sion criterion. The statistical procedure used in this Smid, 
not only provides a statistically determined cost ratio but 
also allows the E to choose an a priori probability of false 
alarms. 

In summary, the performance in a simple vigilance task 
was Significantly enhanced when motivation was increased by 
Statistically calculated monetary incentives. The theory 
that the detectability of the signal remains essentially 
constant and that the increase in caution with time is 
responsible for the vigilance decrement was supported. It 
is believed that a theoretical model of vigilance behavior 


must include motivational parameters. 
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FIGURE 1: MEAN PERCENTAGE OF SIGNALS 
DETECTED AS A FUNCTION OF TIME 
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MEAN PERCENTAGE FALSE ALARMS 
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FIGURE 2: MEAN PERCENTAGE OF FALSE 
ALARMS AS A FUNCTION OF TIME 
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AS A FUNCTION OF TIME 
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13. ABSTRACT 


A vigilance experiment was performed to evaluate the ef- 
fect of monetary incentives on viSual monitoring performance. 
The vigilance task was the detection of a slightly larger ex- 
cursion of a voltmeter needle making 50 uniform excursions 
per minute. The length of the vigil was 48 minutes, during 
which 32 signals were presented. Ten subjects (Ss) in a con- 
trol group performed the task without possibility of reward. 
A second group of 10 Ss performed the identical task receiv- 
ing monetary rewards based on performance. Subjects receiv- 
ing monetary rewards (M) detected significantly more signals 
(Pew O01) VEhan did the contro iagnroup eM) es to theneasr cant 
time decrement (p < .001) and a significant interaction be- 
tween group and time existed (p < .001). The detectability 
(d') or sensitivity for the signals remained essentially in- 
variant for both groups, although slightly greater for group 
M, and the criterion level (beta) was comparatively lower for 
group M. The cost factors were effective in manipulating 
monitoring performance. 
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